Detection In Satellite Images Research Articles

Learning Point Processes and Convolutional Neural Networks for Object Detection in Satellite Images

Convolutional neural networks (CNN) have shown great results for object-detection tasks by learning texture and pattern-extraction filters. However, object-level interactions are harder to grasp without increasing the complexity of the architectures. On the other hand, Point Process models propose to solve the detection of the configuration of objects as a whole, allowing the factoring in of the image data and the objects’ prior interactions. In this paper, we propose combining the information extracted by a CNN with priors on objects within a Markov Marked Point Process framework. We also propose a method to learn the parameters of this Energy-Based Model. We apply this model to the detection of small vehicles in optical satellite imagery, where the image information needs to be complemented with object interaction priors because of noise and small object sizes.

Extraction of roads from satellite images using MATLAB

Satellite imagery is increasingly being used in geographic information and urban planning, with road detection being one of its important tasks. However, traditional road detection methods have some limitations, such as poor handling of sharp turns and intersections. Therefore, the development of automatic road tracking methods based on morphological principles is of significant importance. This study addresses the urgent need for efficient and accurate road detection in satellite images. By combining morphological principles and convolutional operations, the proposed method can accurately identify road networks in complex environments. The advancement of this automatic road tracking technology holds great potential for improving navigation systems and urban planning, greatly enhancing the efficiency and accuracy of road information extraction. Additionally, this technology has far-reaching implications for urban planning. By more accurately capturing road layouts, urban planners can develop more reasonable road construction plans, optimize traffic flow, and improve the quality of life for city residents.

U-Net Inspired Deep Neural Network-Based Smoke Plume Detection in Satellite Images

U-Net Inspired Deep Neural Network-Based Smoke Plume Detection in Satellite Images

Oriented object detection in satellite images using convolutional neural network based on ResNeXt

AbstractMost object detection methods use a horizontal bounding box that causes problems between adjacent objects with arbitrary directions, resulting in misaligned detection. Hence, the horizontal anchor should be replaced by a rotating anchor to determine oriented bounding boxes. A two‐stage process of delineating a horizontal bounding box and then converting it into an oriented bounding box is inefficient. To improve detection, a box‐boundary‐aware vector can be estimated based on a convolutional neural network. Specifically, we propose a ResNeXt101 encoder to overcome the weaknesses of the conventional ResNet, which is less effective as the network depth and complexity increase. Owing to the cardinality of using a homogeneous design and multibranch architecture with few hyperparameters, ResNeXt captures better information than ResNet. Experimental results demonstrate more accurate and faster oriented object detection of our proposal compared with a baseline, achieving a mean average precision of 89.41% and inference rate of 23.67 fps.

BSFCDet: Bidirectional Spatial–Semantic Fusion Network Coupled with Channel Attention for Object Detection in Satellite Images

Due to the increasing maturity of deep learning and remote sensing technology, the performance of object detection in satellite images has significantly improved and plays an important role in military reconnaissance, urban planning, and agricultural monitoring. However, satellite images have challenges such as small objects, multiscale objects, and complex backgrounds. To solve these problems, a lightweight object detection model named BSFCDet is proposed. First, fast spatial pyramid pooling (SPPF-G) is designed for feature fusion to enrich the spatial information of small targets. Second, a three-layer bidirectional feature pyramid network (BiFPN-G) is suggested to integrate the deep feature’s semantic information with the shallow feature’s spatial information, thus improving the scale adaptability of the model. Third, a novel efficient channel attention (ECAM) is proposed to reduce background interference. Last, a new residual block (Resblock_M) is constructed to balance accuracy and speed. BSFCDet achieves high detection performance while satisfying real-time performance, according to experimental results.

A novel framework for fine-grained spatio-temporal change detection in satellite images

A novel framework for fine-grained spatio-temporal change detection in satellite images

Wader hunt optimization based UNET model for change detection in satellite images

Wader hunt optimization based UNET model for change detection in satellite images

Information Extraction of the Vehicle from High-Resolution Remote Sensing Image Based on Convolution Neural Network

Aims: To effectively detect vehicle targets in remote sensing images, it can be widely used in traffic management, route planning, and vehicle flow detection. YOLOv3 deep learning neural network, which mainly studies the vehicle target detection in remote sensing images and carries out the target detection suitable for the characteristics of remote sensing images. Objective: This paper studies the information extraction of vehicle high-resolution remote sensing images based on a convolution neural network. Method: The YOLOv3 network model of vehicle target detection in satellite remote sensing images is optimized. The iterations are set to 50002000045000, and the learning rate is 0.001. At the same time, the comparative experiments of RCNN, Fast RCNN, fast RCNN, and yolov3 network models are carried out. Result: The ca-yolov3 network model can be applied to target detection in satellite images. After 40500 times of learning, the loss function value of the model is reduced to about 0.011. Conclusion: The IOU value of the model also has a good performance in the training process, which makes the yolov3 neural network model more accurate in the image small target detection.

GAN-FuzzyNN: Optimization Based Generative Adversarial Network and Fuzzy Neural Network Classification for Change Detection in Satellite Images

GAN-FuzzyNN: Optimization Based Generative Adversarial Network and Fuzzy Neural Network Classification for Change Detection in Satellite Images

Cascaded U-Net with Training Wheel Attention Module for Change Detection in Satellite Images

Change detection is an important application of remote sensing image interpretation, which identifies changed areas of interest from a pair of bi-temporal remote sensing images. Various deep-learning-based approaches have demonstrated promising results and most of these models used an encoder–decoder shape such as U-Net for segmentation of changed areas. In order to obtain more refined features, this paper introduces a change detection model with cascaded U-Net. The proposed network architecture contains four cascaded U-Nets with ConvNeXT blocks. With a patch embedding layer, the cascaded structure can improve detection results with acceptable computational overhead. To facilitate the training of the cascaded N-Nets, we proposed a novel attention mechanism called the Training whEel Attention Module (TEAM). During the training phase, TEAM aggregates outputs from different stages of cascaded structures and shifts attention from outputs from shallow stages to outputs from deeper stages. The experimental results show that our cascaded U-Net architecture with TEAM achieves state-of-the-art performance in two change detection datasets without extra training data.

Detection of Cloud Cover in Satellite Imagery Using Semantic Segmentation

Accurate detection of cloud cover is an important task in the field of Remote Sensing of the environment. Currently, a lot of development is going on in this field by using various methods. Some of the methods apply concepts of machine learning (ML) whereas some apply deep learning. Since the accuracy of ML being lower than deep learning, the latter is preferred. This paper also uses the method of deep learning to detect cloud cover using images of satellite. This paper proposes a modified U-Net based deep learning model for cloud cover detection in satellite images. The model proposed is not as accurate as the original model, but it compensates for it by reducing the time for learning. The accuracy of the model came out to be 89.73%.

Water Detection in Satellite Images Based on Fractal Dimension

Identification and monitoring of existing surface water bodies on the Earth are important in many scientific disciplines and for different industrial uses. This can be performed with the help of high-resolution satellite images that are processed afterwards using data-driven techniques to obtain the desired information. The objective of this study is to establish and validate a method to distinguish efficiently between water and land zones, i.e., an efficient method for surface water detection. In the context of this work, the method used for processing the high-resolution satellite images to detect surface water is based on image segmentation, using the Quadtree algorithm, and fractal dimension. The method was validated using high-resolution satellite images freely available at the OpenAerialMap website. The results show that, when the fractal dimensions of the tiles in which the image is divided after completing the segmentation phase are calculated, there is a clear threshold where water and land can be distinguished. The proposed scheme is particularly simple and computationally efficient compared with heavy artificial-intelligence-based methods, avoiding having any special requirements regarding the source images. Moreover, the average accuracy obtained in the case study developed for surface water detection was 96.03%, which suggests that the adopted method based on fractal dimension is able to detect surface water with a high level of accuracy.

Semi-Supervised Cloud Detection in Satellite Images by Considering the Domain Shift Problem

In terms of semi-supervised cloud detection work, efforts are being made to learn a promising cloud detection model via a limited number of pixel-wise labeled images and a large number of unlabeled ones. However, remote sensing images obtained from the same satellite sensor often show a data distribution drift problem due to the different cloud shapes and land-cover types on the Earth’s surface. Therefore, there are domain distribution gaps between labeled and unlabeled satellite images. To solve this problem, we take the domain shift problem into account for the semi-supervised learning (SSL) network. Feature-level and output-level domain adaptations are applied to reduce the domain distribution gaps between labeled and unlabeled images, thus improving predicted results accuracy of the SSL network. Experimental results on Landsat-8 OLI and GF-1 WFV multispectral images demonstrate that the proposed semi-supervised cloud detection network (SSCDnet) is able to achieve promising cloud detection performance when using a limited number of labeled samples and outperforms several state-of-the-art SSL methods.

Cloud detection in satellite images with classical and deep neural network approach: A review

Cloud detection in satellite images with classical and deep neural network approach: A review

Automatic Target Detection from Satellite Imagery Using Machine Learning.

Object detection is a vital step in satellite imagery-based computer vision applications such as precision agriculture, urban planning and defense applications. In satellite imagery, object detection is a very complicated task due to various reasons including low pixel resolution of objects and detection of small objects in the large scale (a single satellite image taken by Digital Globe comprises over 240 million pixels) satellite images. Object detection in satellite images has many challenges such as class variations, multiple objects pose, high variance in object size, illumination and a dense background. This study aims to compare the performance of existing deep learning algorithms for object detection in satellite imagery. We created the dataset of satellite imagery to perform object detection using convolutional neural network-based frameworks such as faster RCNN (faster region-based convolutional neural network), YOLO (you only look once), SSD (single-shot detector) and SIMRDWN (satellite imagery multiscale rapid detection with windowed networks). In addition to that, we also performed an analysis of these approaches in terms of accuracy and speed using the developed dataset of satellite imagery. The results showed that SIMRDWN has an accuracy of 97% on high-resolution images, while Faster RCNN has an accuracy of 95.31% on the standard resolution (1000 × 600). YOLOv3 has an accuracy of 94.20% on standard resolution (416 × 416) while on the other hand SSD has an accuracy of 84.61% on standard resolution (300 × 300). When it comes to speed and efficiency, YOLO is the obvious leader. In real-time surveillance, SIMRDWN fails. When YOLO takes 170 to 190 milliseconds to perform a task, SIMRDWN takes 5 to 103 milliseconds.

Object detection in satellite images by faster R-CNN incorporated with enhanced ROI pooling (FrRNet-ERoI) framework

Object detection in satellite images by faster R-CNN incorporated with enhanced ROI pooling (FrRNet-ERoI) framework

Objective reduction in many-objective optimization with social spider algorithm for cloud detection in satellite images

An important difficulty with multi-objective algorithms to analyze many-objective optimization problems (MaOPs) is the visualization of large dimensional Pareto front. This article has alleviated this issue by utilizing objective reduction approach in order to remove non-conflicting objectives from original objective set. The present work proposed formulation of objective reduction technique with multi-objective social spider optimization (MOSSO) algorithm to provide decision regarding conflict objectives and generate approximate Pareto front of non-dominated solutions. A comprehensive analysis of objective reduction approach is carried out with existing multi-objective methods on many-objective DTLZ and WFG test suite which highlight the superiority of proposed technique. Further, the performance of the proposed approach is evaluated on satellite images to detect cloudy region against various types of earth’s surfaces. The performance of the proposed approach is compared against existing benchmark many-objective algorithm, NSGA-III in order to evaluate the potential of proposed method in clustering application. It is observed that obtained clustering results using reduced objective set of MOSSO algorithm provides almost equivalent accuracy with results obtained using NSGA-III with many-objective set.

Multi-spectral cloud detection based on a multi-dimensional and multi-grained dense cascade forest

Cloud detection in satellite images is a vital step for cloud/land recognition, cloud/snow discrimination, and cloud shadow removal. Accurate cloud detection plays an important role in land resource management, environmental pollution monitoring, and land target recognition. Deep learning (DL) algorithms have shown great progress in cloud detection. However, as the complexity of the DL-based model increases, cloud detection efficiency decreases. DL-based cloud detection models are unable to successfully balance the performance-efficiency tradeoff. In our study, a multi-dimensional and multi-grained dense cascade forest (MDForest) is proposed for multi-spectral cloud detection. MDForest is a deep forest structure that automatically extracts low-level and high-level features from satellite cloud images end-to-end; a multi-dimensional and multi-grained scanning mechanism is introduced to capture the spectral information of multi-spectral satellite images while enhancing the representation learning ability of cascade forest. The experimental results on the HJ-1A/1B dataset show that MDForest improves the performance of cloud detection and possesses a good inference efficiency compared with DL-based cloud detection methods, which makes the proposed MDForest satisfy the application where good performance and high efficiency are both required.

Study on Combining Two Faster R-CNN Models for Landslide Detection with a Classification Decision Tree to Improve the Detection Performance

This study aims to improve the accuracy of landslide detection in satellite images by combining two object detection models based on a faster region-based convolutional neural network (Faster R-CNN) with a classification decision tree. The proposed method combines the predicted results from the two Faster R-CNN models and classifies their features with a classification decision tree to generate a bounding-box that surrounds the landslide area in the input image. The first Faster R-CNN model is trained by using a training set of color images (RGB images). The second model is trained by using grayscale images that represent digital elevation models (DEMs). The results from both models are used to construct features for training a classification decision tree. The resulting bounding-box is selected from the following four classes: the box obtained from the RGB model, the box obtained from the DEM model, the intersection of those two boxes, and the smallest box that contains the union of them. The evaluation results show that the proposed method is better than the RGB model in terms of accuracy, precision, recall, F-measure, and Intersection-over-Union (IoU) score. It is slightly better than the DEM model in almost all evaluation metrics, except the precision.

Measuring Human and Economic Activity From Satellite Imagery to Support City-Scale Decision-Making During COVID-19 Pandemic.

The COVID-19 outbreak forced governments worldwide to impose lockdowns and quarantines to prevent virus transmission. As a consequence, there are disruptions in human and economic activities all over the globe. The recovery process is also expected to be rough. Economic activities impact social behaviors, which leave signatures in satellite images that can be automatically detected and classified. Satellite imagery can support the decision-making of analysts and policymakers by providing a different kind of visibility into the unfolding economic changes. In this article, we use a deep learning approach that combines strategic location sampling and an ensemble of lightweight convolutional neural networks (CNNs) to recognize specific elements in satellite images that could be used to compute economic indicators based on it, automatically. This CNN ensemble framework ranked third place in the US Department of Defense xView challenge, the most advanced benchmark for object detection in satellite images. We show the potential of our framework for temporal analysis using the US IARPA Function Map of the World (fMoW) dataset. We also show results on real examples of different sites before and after the COVID-19 outbreak to illustrate different measurable indicators. Our code and annotated high-resolution aerial scenes before and after the outbreak are available on GitHub.1.https://github.com/maups/covid19-satellite-analysis.